Omohundro’s “Basic AI Drives” and Catastrophic Risks
نویسنده
چکیده
Shulman, Carl. 2010. Omohundro's " Basic AI Drives " and Catastrophic Risks.
منابع مشابه
Formalizing Convergent Instrumental Goals
Omohundro has argued that sufficiently advanced AI systems of any design would, by default, have incentives to pursue a number of instrumentally useful subgoals, such as acquiring more computing power and amassing many resources. Omohundro refers to these as “basic AI drives,” and he, along with Bostrom and others, has argued that this means great care must be taken when designing powerful auto...
متن کاملThe errors, insights and lessons of famous AI predictions - and what they mean for the future
Predicting the development of artificial intelligence (AI) is a difficult project – but a vital one, according to some analysts. AI predictions already abound: but are they reliable? This paper will start by proposing a decomposition schema for classifying them. Then it constructs a variety of theoretical tools for analysing, judging and improving them. These tools are demonstrated by careful a...
متن کاملThe Basic AI Drives
One might imagine that AI systems with harmless goals will be harmless. This paper instead shows that intelligent systems will need to be carefully designed to prevent them from behaving in harmful ways. We identify a number of “drives” that will appear in sufficiently advanced AI systems of any design. We call them drives because they are tendencies which will be present unless explicitly coun...
متن کاملShould catastrophic risks be included in a regulated competitive health insurance market?
In 1988 the Dutch government launched a proposal for a national health insurance based on regulated competition. The mandatory benefits package should be offered by competing insurers and should cover both non-catastrophic risks (like hospital care, physician services and drugs) and catastrophic risks (like several forms of expensive long-term care). However, there are two arguments to exclude ...
متن کاملCatastrophic health expenditure among households with members with special diseases: A case study in Kurdistan
Background: One of the main goals of health systems is to protect people against financial risks associated with diseases that can be catastrophic for patients. In 2014, Health Sector Evolution Plan (HSEP) was implemented in Iran; one of the objectives of HSEP was to reduce out-of-pocket payments and provide more financial protection for people. Therefore, the present study a...
متن کامل